Papers with medical visual question answering
ViLMedic: a framework for research at the intersection of vision and language in medical AI (2022.acl-demo)
Copied to clipboard
Jean-benoit Delbrouck, Khaled Saab, Maya Varma, Sabri Eyuboglu, Pierre Chambon, Jared Dunnmon, Juan Zambrano, Akshay Chaudhari, Curtis Langlotz
| Challenge: | Multimodal medical AI is a growing field of interest, especially for tasks that involve multimodal data. |
| Approach: | They propose a vision-and-language medical library to improve multimodal medical predictions and enable new applications. |
| Outcome: | The vision-and-language medical library aims to improve reproducibility and speed up progress across medical AI . it contains a dozen implementations replicating state-of-the-art results on medical datasets . the library is extensible by researchers but also simple for practitioners . |
Act as you think: Reinforcing Consistent Reasoning in Medical Visual Question Answering (2026.acl-long)
Copied to clipboard
Songtao Jiang, Yuan Wang, Ruizhe Chen, Yan Zhang, Ruilin Luo, Bohan Lei, Yeying Jin, Sibo Song, ZhiBo Yang, Jimeng Sun, Jian Wu, Zuozhu Liu
| Challenge: | Recent advances have improved the accuracy of medical visual question answering (Med-VQA) however, the high stakes nature of the medical domain has precipitated a shift towards interpretability and transparency of reasoning processes. |
| Approach: | They propose a reinforcement learning from verifiable rewards framework that rewards internal consistency and logical coherence. |
| Outcome: | The proposed framework rewards internal consistency and logical coherence, and is highly versatile, the authors show. |
Beyond Surface Features: Advancing Medical Vision-Language Alignment via Dynamic Evidence-Guided Preference Optimization (2026.acl-long)
Copied to clipboard
Zixuan Huang, Zhihong Zhu, Xiaolong Liu, Yanchao Hao, Manman Zhang, Zheng Wei, Bowen Xing, Xian Wu, Ye Li, Fen Miao, Yefeng Zheng
| Challenge: | Existing preference-based methods for medical large vision-Language Models face limitations in medical settings . existing methods are limited by overfitting to superficial cues and pseudo convergence of the preference signal. |
| Approach: | They propose a framework that enables evidence-aware and adaptive preference learning for Med-LVLMs. |
| Outcome: | The proposed framework improves evidence-aware and adaptive preference learning for Med-LVLMs. |
AMANDA: Agentic Medical Knowledge Augmentation for Data-Efficient Medical Visual Question Answering (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing Med-MLLMs fail when deployed in low-resource settings where abundant labeled data is unavailable. |
| Approach: | They propose a training-free agentic framework that performs medical knowledge augmentation via LLM agents. |
| Outcome: | The proposed framework performs medical knowledge augmentation via LLM agents. |
Evo-PI: Aligning Medical Reasoning via Evolving Principle-Guided Supervision (2026.acl-long)
Copied to clipboard
| Challenge: | Existing models with static prompts, rules, or reward models are constrained by static supervision, which often fails to shape the underlying reasoning process, leading to brittle generalization and performance saturation in complex decision-making tasks. |
| Approach: | They propose a principle-centric learning framework that treats reasoning principles as explicit, language-based supervision signals that can be generated, evaluated, and iteratively evolved. |
| Outcome: | The proposed framework treats reasoning principles as explicit, language-based supervision signals that can be generated, evaluated, and iteratively evolved. |